Forecasting extreme events in collective dynamics: 
an analytic signal approach to detecting discrete scale invariance 
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A challenging problem in physics concerns the possibility of forecasting rare but extreme phenom- 
ena such as large earthquakes, financial market crashes, and material rupture. A promising line of 
research involves the early detection of precursory log-periodic oscillations to help forecast extreme 
events in collective phenomena where discrete scale invariance plays an important role. Here I inves- 
tigate two distinct approaches towards the general problem of how to detect log-periodic oscillations 
in arbitrary time series without prior knowledge of the location of the moveable singularity. I first 
show that the problem has a definite solution in Fourier space, however the technique involved re- 
quires an unrealistically large signal to noise ratio. I then show that the quadrature signal obtained 
via analytic continuation onto the imaginary axis, using the Hilbert transform, necessarily retains 
the log-periodicities found in the original signal. This finding allows the development of a new 
method of detecting log-periodic oscillations that relies on calculation of the instantaneous phase of 
the analytic signal. I illustrate the method by applying it to the well documented stock market crash 
of 1987. Finally, I discuss the relevance of these findings for parametric rather than nonparametric 
estimation of critical times. 

PACS numbers: 05.45.Tp, 64.60.Ak, 89.65.Gh 
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I. INTRODUCTION 

More than a decade of pioneering research involving 
catastrophic phenomena as diverse as the rupture [l| of 
high pressure rocket tanks 0, stock market crashes Q 
and earthquakes [1] has lent growing credibility [1, Q to 
the hypothesis that such extreme events arise due to co- 
herent large-scale collective behaviors observed in such 
self-organizing systems [11, 0, i, i, i, i, 0, i, i, 0, [HI, 
[H, . An exciting prospect concerns the possibility of 
prediction or forecasting of catastrophic events based on 
the observation of discrete scale invariance. This inno- 
vative approach, when applied to problems such as the 
prediction of earthquakes or financial crashes, questions 
the common assumption that the absence of characteris- 
tic scales seen in self-organizing complex systems 
precludes the possibility of forecasting Q. Instead, pre- 
diction becomes possible due to the appearance of smaller 
precursory events that in principle can help determine 
the critical time tc of the catastrophic event, which one 
can interpret as a finite time moveable singularity. One 
does not directly observe the singularity due to finite size 
effects. Instead we observe an ultra-large event compa- 
rable in magnitude to the system size. The best known 
specific signature of discrete scale invariance involves log- 
periodicity 0, i, [H [H, [13 . Even a small improvement 

in the ability to detect log-periodic oscillations may thus 
have a relatively large impact, with potentially useful ap- 
plications. 

Attempts to forecast extreme events by exploiting dis- 
crete scale invariance and log-periodicity implicitly as- 
sume an underlying information-carrying property of 
some component in the signal studied. Indeed, in trying 
to forecast an event for some variable f{t) that will occur 



at a future time t = tc, with the information [ig] available 
for f{t) at the present time t < tc, one implicitly assumes 
the existence of correlations in the behavior of f{t). Such 
correlations imply that the knowledge of the behavior of 
/(t) in a certain period necessarily provides information 
about the behavior at other (e.g., future) times. For 
a continuous variable /, the maximum degree of corre- 
lation arises for holomorphic or analytic /(t), since one 
can then use analytic continuation to know f{t) for all fu- 
ture times. No new information becomes available when 
time elapses, because f{t) evolves deterministically. Con- 
sider the well known example of classical Hamiltonian 
systems. The fine grained Gibbs entropy, equivalent to 
the Shannon information measure, becomes a constant 
of the motion for such systems due to Liouville's theo- 
rem (see ref. [loj for a discussion of other information 
measures). Indeed, information can increase only if de- 
terministic evolution becomes interrupted in some way, 
e.g., perhaps by some stochastic process. Such interrup- 
tions of deterministic evolution necessarily lead to breaks 
in analytic behavior. From such considerations, it follows 
as a logical consequence that the maximum possible rate 
of transmission of information measured in bits per unit 
time for a physical communication channel must equal 
or exceed the rate of occurrence of non-analytic points in 
the signal [l^l 

Detecting log-periodicity presents unique challenges. 
Direct parametric estimation to obtain log-periodic fits 
can fail due to the presence of extreme fluctuations as 
well as due to the problem of large degeneracy of the so- 
lutions, i.e. there exist too many good fits that approx- 
imate the best fit. Parametric methods also fail because 
often we do not know which underlying distribution to 
assume. Moreover, the large scale catastrophic events 
of interest may represent "outliers" that do not follow 
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the same distribution as the smaller scale events. Hence, 
most of the research has tended to apply non-parametric 
methods. 

A widely used spectroscopic method for detecting log- 
periodic oscillations involves changing the variable t to a 
log-time r = ln(<c — t), and then studying the power 
spectrum of the new series thus generated Q. Log- 
periodic oscillations will appear periodic in the log-time 
r. However, the data will no longer appear evenly sam- 
pled. Hence standard FFT-based methods do not work 
and instead one must obtain the spectrum via the Lomb 
periodogram [2l| . which can handle unevenly sampled 
points. In practice this method works remarkably well. 
Since such nonparametric methods require prior knowl- 
edge of the value of tc, here I investigate the general 
problem of how we can detect log-periodic oscillations 
without having prior knowledge of tc- Such a method 
would in principle allow us to "fine tune" our estimates 
of tc, and then use the nonparametric methods that rely 
on a priori knowledge of tc- The methods developed here 
apply equally to a variety of time series, so a range of 
applications become possible. 

In this context, one of the most dreaded collective phe- 
nomena of our times relates to the financial and eco- 
nomic crises that have punctuated our history since the 
industrial revolution. Economic events, ranging in size 
and diversity from the Great Depression to the ongoing 
bursting of the real estate bubble in the US, affect an at 
least order of magnitude greater number of people than 
earthquakes or tidal waves. Moreover, humans actively 
participate in the dynamics of the economy whereas we 
only passively watch tectonic plate movements. Indeed, 
financial crises have the potential to affect almost every- 
body (unlike, e.g., earthquakes). For such reasons, this 
article limits the application of the new methods devel- 
oped here to the study of cooperative economic phenom- 
ena. Specifically, I have chosen to focus on the classic 
financial "correction" of 1987, when stock market indices 
dropped «20% in an amazing display of cooperative be- 
havior (i.e., "herding") of otherwise rational individual 
agents. 

In Section ini I briefly review discrete scale invariance 
and log-periodicity. In Section IIIII I develop techniques 
for detecting discrete scale invariance. In Sections IIVI 
and |V] I illustrate the method and then apply it to the 
stock market crash of 1987. Section IVTl concludes with a 
discussion and a summary. 



II. COMPLEX DIMENSIONS AND DISCRETE 
SCALE INVARIANCE 

The concept of dimensionality has undergone succes- 
sive generalizations: from integer to fractional to nega- 
tive to complex The fractional and complex jTlj 
dimensions have a relation to fractals [H, and scale 
invariance symmetry, i.e., when a system's property ap- 
pears unchanged under a transformation of scale. Power 



laws, such as f{t) ^ f^, play a fundamental role in de- 
scribing scale invariance. A change of scale by a factor A 
does not alter the power law behavior: f{Xt) — f{t)X'^. 
Real power law exponents usually involve continuous 
scale invariance. In contrast, complex exponents bear 
a relation to discrete scale invariance — a discrete rather 
than continuous symmetry that holds only for certain 
discrete values of the magnification Afc = A*^ . The power- 
ful formalism that emerged from the study and exploita- 
tion of scale invariance in physical systems (25j became 
known as the renormalization group (e.g., see ref. [26j). 
These advances have led to the application of fractal con- 
cepts and techniques to diverse systems, ranging from the 
study of anomalous random walks [13, and critical 
points to heart dynamics [lOl and DNA organiza- 
tion 31, 32]. 

To model a catastrophic event that corresponds to a 
moveable singularity at time t — tc, we can consider 
an arbitrary signal x(t) in terms of the renormalization 
group formalism as follows: 

Fitc -t) = x{tc) - x{t) 

tc-t' ^ (j){tc - t) 

where (j) denotes the flow map and tc the critical time (ssl . 
Is^ l . The flow map acts like a "zoom," mapping the time 
t to a new time t' . We can then express F{t) as a sum of 
a singular part and a non-singular part as follows: 

F{tc - t) = g{tc -t) + -F {(j>{tc - t)) . 

Only the singular part contributes to the ultra-large 
event, whereas the non-singular part only describes nor- 
mal events. Close to the critical point, we can apply the 
linear approximation (/)(t) = At to obtain the power law 
solution, which satisfies 

dFjtc - t) 

dln[tc-t] = "^(^^ - 

with a = In /i/ In A, i.e., we essentially ignore the non- 
singular part. In practice this solution guarantees that 
continuous scale invariance shows up as straight lines on 
double log plots, with the slope given by a, which plays 
the role of a fractal dimension or a scaling exponent. 
If we allow this dimension or exponent to become com- 
plex, a = z + iuj, then the power law {tc — t)" becomes 
(tc — t)^ exp[itt' ln[tc — t]], i.e., a power law modulated by 
oscillations with angular frequency lu in the logarithm of 
the time — hence the term log-periodic. Discrete scale in- 
variance leads to complex exponents a„ = z + ioJn, with 
u)n = 27rn/ In A. 

In a number of applications, the first order representa- 
tion 

x{t) = A + B{tc-ty + C{tc-tf cos[ujh\{tc-t)^'e] (1) 

captures enough of the relevant behavior to become use- 
ful in forecasting and prediction applications Q . Further 
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renormalization group symmetry considerations can lead 
to higher order representations useful in some cases [ssj . 
A different approach to extending Eq. [T] involves the in- 
clusion of higher harmonics. However, the linear approx- 
imation leads us to expect the amplitude of the higher 
order log-periodic corrections to decay exponentially fast 
as a function of the order I of the harmonics [F] . The true 
behavior (i.e., as opposed to the linear approximation) of 
the higher order harmonics leads to a slower exponential 
decay of the higher order harmonics. Nevertheless, the 
first harmonic still provides a good fit and can account 
for the experimental data. Having reviewed the basics of 
discrete scale invariance, I next address the problem of 
detecting it in arbitrary time series. 



III. ANALYTIC BEHAVIOR AND DISCRETE 
SCALE INVARIANCE 

The relationship between analyticity and information 
flow discussed in Section |T] has inspired and allowed the 
development here of methods for detecting discrete scale 
invariance in arbitrary time series. 



A. Detecting discrete scale invariance in Fourier 
space 



How can we exploit the role of correlations to detect 
log-periodicity without prior knowledge of tc? The power 
spectrum, defined as the modulus squared of the Fourier 
transform of the time series, allows us to measure cor- 
relations. Indeed, one could also equivalently define the 
power spectrum as the Fourier transform of the stan- 
dard two-point autocorrelation function. As a starting 
point, let us consider a useful but not widely known fact 
about log-periodic time series and their Fourier trans- 
forms. Discrete scale invariance in a time series can some- 
times also become manifest in the frequency domain. 

Mathematically, log-periodicity in the time domain ap- 
pears in the frequency domain because complex expo- 
nents also appear in the Fourier transform of the signal. 
Consider the indefinite Fourier integral 



dtexp[iuj't] cos [a;ln[ic — t]\ 
1 



2uj' 



{{iuj'itc - t)f"^ T[l - iuj, iuj'itc - t)] 
+ {tc - tf'"^ r[l + iu; iuj'itc ~ 
{—i cos[uj'tc] + sinluj'tc]) 



where r[-, •] denotes the upper incomplete Gamma func- 
tion. This algebraically defined indefinite integral deals 



with complex quantities and represents an antiderivative 
with respect to the integration variable t. Note the terms 
of the form oj' In practice we can evaluate this in- 
tegral with lower and upper integration limits t = —oo 
and t = tc — e to calculate the Fourier transform. 

Figs. [1] and [5] show log-periodic time series and their 
power spectra S{f), defined as the modulus squared of 
the Fourier transform of the time series. We clearly see 
that the log-periodicity in the time domain manifests it- 
self as log-periodicity in the frequency domain, within a 
range of frequencies. Specifically, the log-periodic scaling 
breaks down in the spectra at low and high frequencies 
and the cutoff frequencies depend both on the value of uj 
as well as the temporal separation from the singularity. 
Except for these high and low frequency cutoffs, discrete 
scale invariance in the time domain manifests itself as 
discrete scale invariance in the frequency domain. Note 
that a similar relation holds for continuous scale invari- 
ance, i.e. the Fourier transform of a power law tailed 
function f{t) ^ t^" can also have a power law behavior 
(e.g., at low frequencies). 

An increase in the critical time tc leads to a decrease 
in the upper cutoff frequency in the log-periodicity of the 
spectra. In principle one could exploit this relationship. 
Indeed, we can show in a straightforward manner that 
discrete scale invariance in Fourier space will break down 
near an upper cutoff frequency /high given by 

ln[l + l/(/high(ic - imax))] ~ 2tt/uj , (2) 

where imax denotes the largest time contained in the time 
series. Except for too small uj, we can approximate 

UJ 



/high 



(3) 



27r(ic ^max) 

Hence, one could thus estimate tf. knowing uj and the 
upper cutoff frequency in the spectra. We find that this 
relationship agrees fairly well for the data shown in Fig.[T] 
Yet, in practice I expect that this method may not work 
very well with real data. For realistic time series, the 
spectrum contains too many other features that drown 
out the log-periodic behavior. Perhaps one cannot sys- 
tematically and reliably apply this method to detect log- 
periodic oscillations in realistic scenarios. Nevertheless, 
the concept appears to have validity on a fundamental 
level. 

Moreover, these findings offer insight about the poten- 
tial of investigating analytic behavior for detecting the 
crucial log-periodicities. Indeed, the basic premise of 
forecasting based on exploiting "hidden" analytic proper- 
ties appears valid. Continuing this line of reasoning leads 
to a second approach. Next, I show below that the ana- 
lytic signal obtained using the Hilbert transform of a time 
series can help to isolate the log-periodic signature in ar- 
bitrary time series. I briefly outline the method here be- 
fore describing it detail below. The method involves tak- 
ing the Hilbert transform of the time series to obtain the 
quadrature or analytic signal, consisting of the instan- 
taneous amplitude and the instantaneous phase or argu- 
ment. If the time series behaves purely log-periodically 
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FIG. 1: Examples of log-periodic signals f{t) = cos[a; ln[tc — t]] shown for t — 1,2,3, . . . 2^^ with lu — 30 and tc = 2^^' + 1 (a), 
tc = 65600 (b) and tc = 70000 (c), along with their corresponding power spectra (d,e,f). An increase in the critical time tc 
leads to a decrease in the upper cutoff frequency in the log-periodicity of the spectra. In principle, one could thus estimate tc- 



~ exp[i<x' ln(ic ^ t)], then the phase will behave logarith- 
mically, ~ oj ln{tc — t) . On the other hand, experimen- 
tally obtained data will realistically always have non- log- 
periodic components, so a pure log-periodic series repre- 
sents an impractical idealization. 

In the more realistic case of a time scries with a small 
log-periodic component, the analytic signal pliasor will 
rotate log-periodically in the complex plane not around 
the origin, but rather around some other point on the 
complex plane. In principle this "center" or "focus" of 
log-periodic rotation can itself fluctuate in time, due to 
the many other components that contribute to the an- 
alytic signal. Hence, in the case of a small log-periodic 
component in the time series, the phase of the analytic 
signal will not vary as ~ Lo\n{tc — t). Instead the phase 
will have a component that oscillates log-periodically, due 
to the angle subtended at the origin by the analytic sig- 
nal phasor tip. The log-periodicity contained in a time 
series need not necessarily appear in the amplitude of the 
analytic signal (e.g., consider how a pure log-periodic os- 
cillation has constant amplitude). In contrast, the log- 
periodicity necessarily appears in the phase of the an- 
alytic signal. By studying the instantaneous phase, we 



may thus enhance or highlight the log-periodicity appar- 
ent in time series. 



B. The Hilbert transform 

The Hilbert transform H f{x) of a function f{x) repre- 
sents the convolution of the function / with l/nx. Math- 
ematically, we define the Hilbert transform as a Cauchy 
principal value. 



Hf{x) 



lim 

+0,iJ-. 



J-R y-x 



y-x 



to avoid the singularity at x. Moreover, cancellation to- 
wards ±00 allows non-integrable functions to have well 
defined Hilbert transforms. The Hilbert transform also 
corresponds to the inverse Fourier transform of the prod- 
uct of the Fourier transform of ,f{x) with i sgn(.T) (where 
the latter gives the Fourier transform of I/ttx) . Hence the 
Hilbert transform effectively maintains the Fourier am- 
plitudes but shifts all phases by — 7r/2. Hence = — 1. 
The Hilbert transform of x{t) allows us to define an 
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FIG. 2: More examples of log-periodic signals f{t) = cos[a; hi[tc — t]] shown for t — 1, 2, 3, . . . 2^^ with tc = 2^^ + 1 and uj — 30 
(a), u! = 20 (b) and w = 10 (c), along with their respective power spectra (d,e,f). As a general rule, for low frequencies at 
least, discrete scale invariance in the time domain also manifests itself in the frequency domain. Notice that variation of the 
time-domain angular frequency uj leads to a change in the log-periodicity observed in the frequency- domain. In principle, one 
could thus estimate tc knowing uj and the upper cutoff frequency in the spectra (see. Fig[T]). In practice, however, we cannot 
rely on this method for the more realistic case of noisy data. This limitation motivates other approaches for estimating tc for 
actual experimentally measured time series. 



analytic signal 

X{t) = x{t) + iHx{t) = A{t) exp[i<y9(i)] , 

where A{t) and Lp{t) represent the instantaneous ampli- 
tude and phase of the signal. This and related properties 
have led Hilbert transforms to have important and di- 
verse applications (e.g., see refs. [ssl IsgI i37.]). 

C. Analytic signal of log-periodic data 

For a pure log-periodic analytic signal 

x{t) = exp[icjln[tc - t]] 

the "unwrapped" instantaneous phase will follow 

Lp{t) — uj\n\tc — t]. 

Since in Nature we typically observe log-periodicity "dec- 
orating" a power law or else hidden in noisy data, we 



must consider an analytic signal of the form 

x{t) — Xo(^) + o, exp[iw \n\tc — t] — A{t) exp[i(^(t)] , 
with a < Xo{t)- Let xo(^) = ^o(^) exp[i(/7o(i)]- Then 
A(t) = ^ Al{t)+a'^ + 2Ao{t) a cos [ipait] - Lj\n[tc - t]] 
and 

Aa{t)sin[ipQ{t)]+asm[uj\n[tc-t]] 
/ — arctan — — — — p -y 

A(i[t) cos[ipo[t)\ + a cos |_cjln[tc — t\\ 

Notice that log-periodicity need not appear in A{t)^ by 
considering for instance, the important case AQ{t) — 0, 
for which we obtain A(t) = a = constant. In con- 
trast, log-periodicity will always appear in the phase ip{t), 
which contains the information arising from the com- 
plex exponents associated with discrete scale invariance. 
The phase, calculated as an arctan will belong to a sin- 
gle branch on the complex plane, but we can "unwrap" 



6 



40 




2000 4000 6000 8000 10000 
2 I 1 1 1 1 1 1 1 1 1 1 




FIG. 3: (a) Example of a log-periodicity "decorating" a power law, shown for times t prior to the singularity tc ■ Formula 
used: f{t) — cos(50 * log 10(11000 — t)) + 1000 * (11000 — t)^"'''. (b) A typical noisy time series g{t) containing the log-periodic 
component shown in (a) above, with a log-periodic signal-to-noise amplitude ratio of 2:5. This noisy signal served as test data 
to illustrate the method, (c) Numerically calculated discrete Hilbert transform of the series shown in (b). (d) Instantaneous 
phase ip{t) of the analytic signal before and after (e) detrending with polynomial regression (of order 4). I obtained the positions 
of the minima and maxima (shown as triangles) using quadratic regression (parabolic solid lines) applied in the regions of each 
peak and valley. 
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FIG. 4: Logarithm of the inter-extrema intervals At = tn — 
tn+i observed in the log-periodic signal shown in Fig. |3je) 
versus the index n. The regression coefficient obtained leads 
to a value of = 21.6. Compare this with the known value 
(see Fig. |3ja)) uj — 21.71, corresponding to an error of less 
than 0.5%. 



12000 - 



10000 




FIG. 5: The times (open circles) corresponding to the extrema 
of the log-periodicity shown in Fig.[3l[e), as well as the product 
At„/(1 — exp[— tt/oj]) of the inter-extrema intervals and the 
scaling factor of the geometric series of Eq.[5](open squares). 
Their sum should equal the critical time tc and we indeed 
observe this (filled diamonds). We thus obtain an estimate 
tc = 11040 ± 370. Compare this estimate with the known 
value tc — 11000. The discrepancy lies below 1% and the 
standard deviation represents less than 5%. 



the phase to make it vary outside the conventional range 
— 7r/2 < tp < 7r/2, to avoid abrupt discontinuities at the 
branch cut. 



IV. AN ILLUSTRATIVE EXAMPLE 

The technique developed above finds practical applica- 
tion to arbitrary time series. Consider, as an illustrative 
example, the log-periodic oscillation decorating a power 
law shown in Fig. [3]^ a). In a realistic situation, we would 
never observe such a clean signal. Rather, it would be 
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FIG. 6: (a) Price P{t) corresponding to the S&P index shown 
for approximately 5000 business days, culminating in the 
"great correction" of October 1987. The forecasting tests used 
only the data shown in black and the grey data near the crash 
appears solely for visual clarity (with time t = chosen ar- 
bitrarily), (b) the instantaneous phase (p(t) after polynomial 
regression and (c) after further detrending by subtraction of 
the cumulative average (dashed line) defined in Eq. [T] result- 
ing in a detrended phase signal tpdif)- The estimated positions 
of the maxima come from quadratic regression. I have indi- 
cated their positions labelled by the index n. Notice that the 
peaks at n = 7 and n = 8 appear nearly indistinguishable, but 
they actually appear distinct at smaller scales (not shown). 
The decreasing intervals for successive n > 2 suggests the 
possibility of discrete scale invariance. 



embedded in noise or added to other types of signals. 
Fig. [3{b) shows the same log-periodic signal with noise 
added. Our goal involves finding the critical time from 
such data. 

Let us thus use the signal shown in Fig. [3l^b) as our test 
data. Applying the method described in the previous 
section. Fig. [3]Jc) shows the discrete Hilbert transform 
of the signal and Fig. [Hd),(e) show the instantaneous 
phase calculated from the analytic signal before and after 
detrending. 

The last plot, shown in Fig. [3{e), permits an estima- 
tion of the times of the minima and maxima. I have used 
quadratic regression fits in the region of the extrema, due 
to the validity of the parabolic approximation. In princi- 
ple, other methods may work equally well. Alternatively, 
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FIG. 7: Logarithm of the inter-maxima intervals At = t„ — 
tn+i observed in the signal shown in Fig. |6] versus the index 
n. The regression coefficient obtained leads to an estimate of 
ij (see Table m 
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FIG. 8: The times (open cicles) corresponding to the maxima 
of the log-periodicity shown in Fig.[6jc) , as well as the product 
Ai„/(1 — exp[— tt/oj]) of the inter-maxima intervals and the 
scaling factor of the geometric series of Eq.[8](open squares). 
We thus obtain an estimate for tc (filled diamonds). Table U 
summarizes the results. 



one could estimate the times corresponding to the zeroes 
rather than the extrema. Yet another possibiUty includes 
direct parametric fitting of a log-periodic cosine function. 
I have not used this direct parametric estimation due to 
the reasons mentioned in Section |TT1 

Nevertheless, knowledge of the times of the extrema 
permits parametric estimation of the log-periodic angular 
frequency lu Fig. 3] I have used 



Atn — exp[— Trn/cj] (exp[— vrcj] — 1) 



(4) 



where n denotes an arbitrary integer index to identify 
successive extrema and At'^"-' = tn+i ~ tn represent the 
inter-extrema intervals. The Hmit n ^ oo leads to the 
singularity. The regression coefficient obtained leads to 
a value of lo — 21.6, compared with the known value 
uj = 21.71. Notice the remarkable agreement. 

Once we have knowledge of lo and the positions of the 



extrema (or zeroes), it becomes straightforward to find 
the critical time. From Eq. ^ it follows that the inter- 
extrema intervals follow a geometric series defined by 



The critical time tc thus satisfies 



1 — exp[— tt/w] 



(5) 



(6) 



Fig. O shows the times t„, the inter-extrema intervals 
Atn, and the estimated values for tc- We obtain an esti- 
mate for tc in excellent agreement with the known value. 

Previous applications of the Hilbert transform to study 
log-periodic precursors (e.g., of financial crashes ISTII) 
have assumed prior knowledge of tc- The log-time [33] 
T = ln(tc — t) behaves not log-periodically, but periodi- 
cally, rendering the use of Hilbert transforms useful. In 
contrast, here we have assumed no prior knowledge of tc- 
Rather, such knowlegde constitutes the goal. 

In summary, the method uses the following steps: (i) 
generation of the analytic signal from the original time 
series, (ii) extraction of the instantaneous phase and any 
necessary "unwrapping" of the phase, (iii) detrending 
with polynomial regression etc., (iv) testing for evidence 
of log-periodicity using more conventional methods. If 
applicable, then the final and most important step con- 
sists of estimating the location of the moveable time sin- 
gularity tc by regression methods. 

The above example illustrates step by step the appli- 
cation of the method to arbitrary time series. Below I 
apply the method to actual empirical data. Indeed, the 
crucial question concerns whether the method works for 
actual experimental data. I have chosen for this purpose 
the stock market crash of 1987, since it represents a well 
known event in which the collective social behavior of in- 
dividual economic agents unleashed financial havoc and 
in which systematic studies have documented the role 
played by log-periodicities. 



V. THE STOCK MARKET CRASH OF 1987 

Fig. [BJa) shows data corresponding to approximately 
5000 business days of the S&P500 financial index |38| 
(which has ticker symbol "SPC" ). The area in grey shows 
the crash of October 1987, when stock markets lost some 
20% of their valuation. Since the idea behind the pro- 
posed method involves forecasting the crash, I applied 
the method only to the data shown in black. The data 
in grey appears only for greater visual clarity. 

Fig-EUb) shows the instantaneous phase ip'{t) after de- 
trending with polynomial regression. To emphasize the 
oscillations, I have further detrended the data by sub- 
tracting a uniformly weighted moving average y(t) with 
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Data points from Fig. E 


LU 


tc 


Calendar dates 


n = 1, 8 excluded 
n = 1 excluded 
All points 


0.076 
0.110 
0.090 


9681 ± 107 
9419 ± 179 
9548 ± 86 


2/10/1987—8/8/1988 
9/6/1986—5/11/1987 
24/4/1987—29/12/1987 



TABLE I: Estimates of the log-periodic angular frequency to and tc found from Fig. [T] The first and last points in Fig. [7] 
(n = 1, 8) deviate further than the middle points from an exponential behavior. Therefore, I have shown three estimates for u): 
(i) taking all points into account, (ii) taking only the middle points into account, excluding the first and last points, and (iii) 
taking all but the the first point into account. (The a priori known value is tc ~ 9582.) In all three cases, I dropped the n = 1 
point to estimate tc, since it clearly does not belong to the same regime as the other maxima, as seen in Fig.jS] Remarkably, all 
three estimates for tc surprisingly bear consistency with the actual stock market crash that followed in the middle of October 
1987. 



varying window size, using 



VI. CONCLUDING REMARKS 



rrri:'''"'' 



(7) 



where <max corresponds to the last point of the series. 
I arbitrarily have chosen 17 June 1987 as the last data 
point included in the test. This date corresponds to some 
80 business days (i.e., several months) antecedent to the 
crash of October 1987. 

Fig.lSfc) shows the phase after detrending with y{t). I 
have estimated the positions of the maxima using using 
parabolic regression and have arbitrarily labelled each 
maxima with an index n — 1,2,...., 8. Notice that 
for n < 2 no sign appears of the characteristic log- 
periodicity. However, for n > 2 the intervals between 
maxima become smaller, consistent with a possible log- 
periodicity. I have chosen to show only the maxima, be- 
cause the minima appear less clear. So in what follows, 
note that I use a phase variation of 2ti for successive n, 
in contrast to the a phase variation of tt for the inter- 
extrema intervals. So we must replace Eq. [5]by 



n+l 



and Eq. [S] similarly becomes 



— exp[— 27r/a;] 



tr 



tr. 



1 — exp[— 7r/(jj] 



(8) 



(9) 



Fig. [7| shows the inter-maxima intervals At„. Notice 
the approximate exponential behavior. Using regression, 
we can estimate the log-periodic angular frequency ui. 
Then, we can apply Eq.[B]to estimate the crash, assuming 
that it should occur near the singularity. Fig.[S]shows the 
estimates for tc and Table U summarizes the results. All 
estimates contain the actual crash within the margins of 
error. Clearly, we must reject any estimate for that 
occurs within the dates studied, since we know a priori 
that no such event transpired. 



Several points deserve commenting. One thought- 
provoking point concerns the analysis of the 1987 crash. 
The results reported here might bear some relation to 
previous findings. The very large-scale log-periodic os- 
cillations seen in Fig. [H] are not inconsistent with similar 
conclusions in previous studies [6*]. Such results raise a 
number of questions and the implications merit further 
study. Was the financial crisis of 1987, which few had 
anticipated even one month prior to the crash, really be- 
ing slowly built up over large time scales spanning years? 
Were the individual and institutional agents really start- 
ing to behave collectively so long before the crash? What 
about the implication for the individual agents: is our 
apparently "free will" essentially irrelevant to collective 
dynamics? 

Moreover, in the past few years, financial institutions 
(and some individuals) have started to use automated 
trading software to buy and sell financial assets (in real 
time [331 )■ Each algorithmic "robo-trader" [4(| follows a 
given set of rules of arbitrary complexity, however other 
traders (human and robotic) do not know the specific 
rules and thus cannot exploit them to obtain financial 
arbitrage. How will the advent of large numbers of robo- 
traders affect the collective dynamics and what are the 
implications relating to the probability of financial crises? 

Another noteworthy aspect concerns the the general 
nature of the methods developed here, whose application 
goes beyond financial data. One of the major difficul- 
ties in parametric estimation of log-periodic properties 
is due to the lack of foreknowledge of tc- It is not in- 
conceivable that even small improvements in the ability 
to estimate tc can be of potential use in forecasting re- 
search. It would be interesting to apply and further study 
the method using other data sets. Given the recent ap- 
plication_ of physical methodologies to study music time 
series [41,], it is even conceivable that such methods could 
be applied to obtain quantitative descriptions of aesthetic 
phenomena in the arts. In fact, wherever cooperative ef- 
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fects are involved, there is a real possibility that discrete 
scale invariance plays some role. For example, an inter- 
esting question, in this context, is whether the method 
is applicable to coherent noise phenomena [13, S, El]- 
Concerning the method itself, there is room for further 
improvement, e.g., corrections for finite size effects of the 
conventionally used Hilbert transform algorithm. Simi- 
larly, one could take into consideration the role of log- 
periodic harmonics, which no doubt play an important 
role in such phenomena. Such issues are important but 
their relevance is secondary to the more significant ques- 
tion of the theoretical basis for the method. The in- 
clusion here of further discussion about such secondary 
issues would detract from the central focus. 

In summary, I have investigated two distinct ap- 
proaches towards the general problem of how to detect 
log-periodic oscillations in arbitrary time series without 
prior knowledge of the location of critical time. The more 



promising method involves analytic continuation of the 
signal onto the imaginary axis, using the Hilbert trans- 
form. I have shown that the instantaneous phase nec- 
essarily retains the log-periodicities found in the origi- 
nal signal and develop a new method of detecting log- 
periodic oscillations. Initial results of the application of 
the method to the stock market crash of 1987 motivate 
further systematic studies to verify how much promise 
this approach holds for forecasting extreme events. 
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